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M ETHODS IFOR DYNAMIC BANDWlDTlf AlXOCATION AND QU EUE 
MANAGEMENT IN ETHERNET PASSIVE OPTICAL NETWORKS 

CROSS REFERENCE TO EXISTING APPDCATIONS 

5 

This application claims prioriiy from U.S. Provisional Paieni Application No. 
60/410,317 filed September 13, 2002, and from U.S. Provisional Patent Application No. 
60/4 10,170 filed September 25, 2002, boih of which are incorporated herein by reference, 

10 HELD OF THE INVENTION 

The present invention relates generally to data access methods, and more particularly, 
to methods for optimizing data transmission in Ethernet packet traffic over Passive Optical 
Network (PON) topologies. 

15 

BACKGROUND OF THE INVENTION 

The Ethernet PON (EPON) is using 1 gigabit per second Ethernet transport, which is 
suitable to very high-speed data applications, as well as to converged system support 

20 (telephone, video, etc.). The unprecedented amount of bandwidth is directed toward, and 
arriving from a single entity, the Optical Network Unit (ONU). 

An EPON network can be viewed as a distributed switch. An Optical Line Terminal 
(OLT) manages remotely the transmission of each ONU. The OLT and the ONUs exchange 
messages. In each cycle of such ah exchange, the OLT grants a grant to each ONU» which is 

25 answered by a report message from the ONU. The ONU has a queue manager that prepares 
queue status information, which is transmitted using MPCP messages to the OLT to enable 
smart management. In other words, the ONU "informs its internal queues status" to the OLT. 
The OLT management is executed using a Dynamic Bandwidth Allocation (DBA) algorithm. 
An efficient algorithm is essential 40uguar^atee Quality of Service (QoS), required to fulfill a 

30 Service Level Agreement (SLA), Operator revenues will increase from selling sophisticated 
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SLAs to customers. High bandwidlh utilization allows adding more customers to the network. 
Thus, a queue manager in an ONU is an enabler for any DBA algorithm executed by the OLT. 

One of the key causes for low bandwidlh utilization is the packet fragmentation loss. 
A fragmentation loss occurs when a grant does not match precisely the amount of bytes to be 

5 transmitted by the ONU- An ONU is not allowed to fragment packets, causing the remaining 
portion of a grant to be wasted. FIG I shows a grant with a grant length 102. If for example 
three packets, marked #1, #2, and #3, are to be included in the grant, packets, #1 and #2 will 
fit, while packet #3 will not. There will be a fragmentation loss 104 given by the grant length 
minus the sum (in bytes) of the packets transmitted. 

10 FIG. 2 shows a prior art EPON system comprising an OLT 200 and a plurality of 

ONUs 202. The OLT and the ONUs exchange messages. In each cycle of such an exchange, 
the OLT grants a grant G to each ONU, which is answered by a report message REP from the 
ONU to the OLT. For example, the reporting by the ONU to a grant received in a cycle N-1 at 
a grant message lime tc(N-l) occurs at a report message transmission time tR(N-J). Regardless 

15 of the particular algorithm be used to differentiate between ONUs, the basic granting scheme is 
identical. An ONU must have a deterministic behavior in the time period between report 
message transmission and grant message reception, i.e. tc(N-l) - tR(N-l). The information of 
the OLT is updated only up to tR(N-l). The transmission order depends on packet priority, 
which can be any arbitrary value (e.g. 0. 7 in EPON). In this case, 0.7 means that there are 8 

20 priorities, numbered from 0 to 7, with 0 being the lowest and 7 being the highest. Whenever a 
packet of a higher priority exists in the queue, it will be transmitted before any packet of a 
lower priority. 

The ONU reports the total number of bytes ("total bytes") existing in any of the sub- 
queues. The IEEE802.3 standard allows reporting additional information per sub-queue, the 

25 additional information based on deflning a programmable threshold, per sub-queue. The 
threshold is set by the OLT using a proprietary message. For example, in a sub-queue with 5 
packages of priority 0.5, the threshold in bytes may be 1600, 4000, 3000. 3000, 4000 and 2000, 
respectively. The ONU reports the total number of bytes below the programmable threshold. In 
the example above, this number could be 1500, 0, 2800, 0, 3900 and 1500, and it is a result of 

30 the actual queue occupancy. Utilizing this information will help to reduce the grant size, which 
can be used for finer granting. 
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RG 3 shows a flow chart of the steps in the reception of a packet to a queue by ihe 
ONU, as occurring in prior art systems. The packet is written in step 300, and the priority of 
the packet is extracted in step 302. The length of the new packet is added to the content ("total 
bytes") of the appropriate (same priority) packet sub-queue in step 304, to yield a new "total 
5 bytes" value. If the combined value of "bytes below threshold" and packet length is still 
smaller than the threshold of the sub-queue, the value of the "bytes below threshold" of the 
particular sub-queue is incremented with the packet length in step 306. Else, the value of the 
"bytes below threshold" remains unchanged. For example, a packet with a length of X bytes is 
added to the relevant sub-queue that has a threshold T and a value of "bytes below threshold" 
10 M. If X+M<T, M= M+X. Else, M remains unchanged. 

The methods used in prior art result in packet fragmentation losses and therefore low 
bandwidth utilization. It is thus desirable to provide a new set of efficient management 

m 

methods and algorithms that will eliminate packet fragmentation losses, enable efficient full 
bandwidth utilization and guarantee QoS. 

15 

SUMMARY OF THE INVENTION 

The present invention discloses various embodiments of dynamic bandwidth 

• * 

allocation methods and algorithms, designed to avoid fragmentation loss. Their main 
20 innovative aspect is guaranteeing that a length of a grant issued by an OLT will match 
precisely the count of bytes to be transmitted by an GNU. The present invention provides, in 
various embodiments, methods for determining an ONU uplink transmission egress order (also 
referred to as "ONU egress order"), and of an ONU report threshold setting (also referred to as 
"threshold setting"). Existing queue management algorithms such as "Strict priority", "Fair 
25 queuing" and their derivations, are not suitable for distributed switch management, as they do 
not consider EPON protocol events, such as the time a "Report" message was transmitted. In 
contrast, the queue management methods and algorithms disclosed herein takes into 
consideration EPON protocol events, such as queue occupancy at a "Report" message 
preparation time, and at a "Grant" message handling time. 

30 According to the present invention, there is provided in a passive optical network a 

method for transmitting packets by an ONU comprising the steps of receiving a grant having a 

3 
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grant length from an OLT, and based on the grant, calculating an ONU packet egress order 
that eliminates packet fragmentation. 

According to the present invention, there is provided in a passive optical network a 
method for eliminating packet fragmentation comprising the steps of providing an OLT 
5 connected to a plurality of ONUs, each of the ONUs transmitting packets arranged in sub- 
queues having a total byte length, the packets transmitted in response to a grant having a grant 
length and received from the OLT, and matching the total byte length with the grant length, 
whereby the fragmentation loss is eliminated. 

0 

m 

According to the present invention, there is provided a method for setting a threshold 
10 for dynamic bandwidth allocation in a passive optica] network that includes an OLT and a 
plurality of ONUs, the method comprising the steps of providing a weighted fair queueing 
configuration to the OLT, and providing a threshold used in combination with the weighted 
. fair queueing configuration while granting a grant with a desired grant length to an ONU. 

According to the present invention, there is provided a method for setting a threshold 

.* 

15 in a passive optical network that includes an OLT and a plurality of ONUs, the OLT granting 
grants to the ONUs, which in turn transmit packages arranged in sub-queues in response to the 
grants, the method comprising the steps of performing a comparison between ONU-reported 
parameters and a desired grant length, and adjusting a threshold based on the results of the 
comparison, thereby providing a target bandwidth adaptation mechanism in which the 

20 threshold value of all sub-queues is identical. 

According to the present invention, there is provided a method for setting a threshold 
.in a passive optical network that includes an OLT and a plurality of ONUs, the OLT granting 
periodically a grant having a grant length to each ONU, the ONU transmitting packages 
arranged in sub-queues in response to the grant, the method comprising the steps of providing 

25 a plurality of priorities, each associated with a sub-queue of packages, each priority having a 
unique priority threshold, and adjusting each priority threshold such that a sum of all the 
adjusted priority thresholds has a fixed value. 

BRIEF DESCRIPTION OF THE DRAWINGS 

30 

The invention is herein described, by way of example only, with reference to the 
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accompanying drawings, wherein: 

FIG I shows schematically an example of fragmentation loss; 

FIG. 2 shows schematically a prior art method for controlling messages flow between 

5 an OLT and an ONU; 

HG. 3 is a flow chart of packet reception by an ONU; 

FIG. 4 shows a flow chart of the steps in the report preparation and storage by an 

ONU; 

■ 

FIG. 5 shows a preferred embodiment of the method for determining an ONU uplink 
10 transmission egress order according to the present invention; 

FIG. 6 is an example of a queue egress process; 

FIG. 7 is a diagram showing the timing relation between queue ingress and egress 
processes; 

m 

FIG. 8 shows an implementation of WFQ using threshold setting according to the 
15 present invention; 

_ m 

FIG. 9 shows a flow chart of the steps of a threshold setting method using the TABA 
mechanism according to the present invention; 

FIG. 10 shows a flow chart of the steps of a threshold setting method using the PTM 
mechanism, according to the present invention; 
20 FIG. 1 1 is a flow chart of a desired grant length calculation; 



DESCR J PTION OF THE PREFERRED EMBODIMENTS 



The present invention provides, in various embodiments, methods for determining an 
25 ONU egress order, and of an ONU threshold setting. These embodiments are now described in 
detail below. 



ONU egress order 

30 The key feature for avoiding fragmentation loss is the OLTs ability to control the 

transmission order of packets transmitted by an ONU. The system and algorithm of FIG. 2 do 



5 
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not avoid fragmentation loss because they use a single test of a stage variable, as opposed to a 
three-test procedure in the method of the present invention described below. Any update in 
the status of a queue (i.e. the list of packets with their lengths and their transmission order, 
which is a function of priority) at a specific time must be hidden from the OLT. According to 

5 the present invention, in order to hide the packet transmission events, an ONU performs a pre- 
calculation of packet transmission order for an upcoming grant. When the grant message 
arrives, the ONU calculates the order of packets supposed to be transmitted, and marks these 
packets as "about to be transmitted". If more grants arrive, the ONU will ignore the marked 
packets as if they were already transmitted, although, in practice, those packets are still in a 

10 transmission queue, waiting for their upcoming transmission. The transmission queue 
comprises sub-queues, each including packets of the same priority. 

In order to hide packet recepuon events, an ONU must freeze (i.e. lock the 
transmission order oO its queues. A packet received from a user port will not be transmitted, 
unless the ONU pre-calculation marks the packet as "about to be transmitted" in the start time 

15 specified in the grant message. 

FIG. 4 shows a flow chart of the steps in the report preparation and storage by an 
ONU. In a report preparation step 400, the current values of "total bytes" and of "bytes below 
threshold" of each sub-queue are embedded inside the report message. These parameters are 
stored in step 402 in two storage array variables: a stored array value of "total bytes", and a 

20 stored array value of "bytes below threshold", both being used in the method for determining 
the ONU transmission egress order below. 

FIG. 5 shows in a flow chart a preferred embodiment of the method for determining 
an ONU uplink transmission egress order according to the present invention. The description 
refers to one cycle in a series of cycles that represent continuous operation of grants. Each 

25 cycle sees a grant being granted by the OLT. A new grant sent by the OLT is handled by the 
ONU in step 500. A "remaining grant length" (i.e. a variable storing the available space (in 
bytes) left in a grant to be filled) is loaded with the grant length value arriving with the grant in 
the present cycle. Any messages handled via special queues, such as report messages in a 
Multi-Point Control Protocol (MPCP), are first decreased from the remaining grant length in 

30 step 502. The method includes a number of actions run in preferably three "stages", each such 
stage involving a series of actions performed on a "stage variable". The three stage variables. 



wo 2004/025903 




PCT/IL2003/000702 



each lesled or "acted upon" in each cycle are (preferably in ihis order): "reported byles below 
threshold", "reported lolal bytes", and "loial bytes". Each stage variable is treated separately, 
starting with a stage lhai treats "reported bytes below threshold", which undergoes processing 
according to steps 504 to (potentially) 518, the second stage repeating the process with 

5 "reported total byles", and the third stage repealing the process with "total bytes". 

In the first stage, the stage variable value is initialized to "reported bytes below 
threshold'* in step 504. The highest priority sub-queue starts to be handled in step 506. 
"Handling" in this context indicates acting upon or treating only this sub-queue. In step 508, 
the sub-queue is checked to see if it includes ungranted packets, i.e. if there is at least one 

10 packet that has not been granted yet, and which can be potentially transniitted. If there is no 
such packet, the execution continues from step 518. If there is such a packet, its length is 
compared with the remaining grant length in step 510. If the ungranted packet Fits inside the 
grant (i.e.. the grant length is bigger than the ungranted packet length) a "stage condition" 
(explained below) is checked in step 512. If the ungranted packet does not fit inside the grant, 

15 execution continues in step 51S. The type of check run for the stage condition in step 512 
depends on the chosen stage variable. If the stage variable used; is ^'reported bytes below 
threshold", its value is compared to 0. Similarly, if the stage variable used is "reported total 
bytes", its value is compared with 0. and if the stage variable used is "total bytes", its value is 
compared with 0. In other words, the execution moves to, and continues from, step 518 in each 

20 of the following cases: the result of the comparison in step 512 is 0, a failure occurs in step 510 
(i.e. an ungranted packet has a length too long for the grant), or a failure occurs in step 508 (i.e. 
there are no ungranted packets in sub-queue). If the stage condition checked in step 512 
succeeds, meaning the value of the compared stage variable is greater than 0, execution 
continues from step 514. In this step, the packet is marked as "granted", (i.e. is no longer 

25 considered as ungranted). In the following step 516, the "granted" packet length is subtracted 
from all variables, namely from the remaining grant length, from "reported bytes below 
threshold", from "reported total bytes", from "reported bytes below threshold", and from "total 
bytes". However, if the value of one these variables is 0, the "granted" packet length is not 
subtracted from it. The execution then returns to step 508, where the sub-queue is investigated 

30 again, for a next packet. 

If any of the comparison checks in steps 508, 510 or 512 results in the execution being 

7 
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sent to step 518, in step 518, the priority of the presently handled queue is compared with the 
lowest priority. If the priority of the presently handled sub-queue is not the lowest priority, 
then in step 520 the priority of the presently handled sub-queue is decreased by 1, to enable 
handling of the next priority sub-queue. The execution returns to step 508, where the new sub- 

5 queue starts to undergo the same sequence of steps as above. If the priority of the presently 
handled sub-queue in step 518 is the lowest, execution continues from step 522. In step 522, 
the stage variable is checked to see if it is set to "total bytes". If yes (stage variable is "total 
bytes") the operation is completed, and the execution returns to step 500, to wait for the next 
grant. If no (stage variable is set to one of the other two possibilities), the execution continues 

10 to step 524, in which the stage variable is updated. That is, if the just processed stage variable 
was "reported bytes under threshold", the variable is now. updated (set) to be "reported total 
bytes", and if it was "reported total bytes" it is set to "total bytes". The execution continues 
from step 506, where other sub-queues start to be examined again from highest to lowest 

m 

priority. 

15 In summary, the method includes running, for each sub-queue, a series of tests in 

preferably three stages. Each stage includes a check of a stage variable value against a set 
value (zero). Based on the result of the check, a previously ungranted packet is either "marked 
as granted" and shunted aside, or left in the sub-queue, the process being replayed with the 
next highest priority sub-queue. In contrast with prior art methods that employ only one 

20 (instead of three) tests, the method embodied by the flow chart in FIG. 5 guarantees a perfect 
match (eliminates packet fragmentation) between the OLT granting decision, which is based 
on its latest knowledge, and the ONU egress order. It allows a flexible OLT grant length 
selection, which can be any combination of values of "bytes below threshold" and "total bytes" 
values. The single constraint is that these values must be accumulated from highest to lowest 

25 priority, and that all "bytes below threshold" must be accumulated before adding "total bytes" 
to grant length. Prior art methods include the equivalent of only one stage (and test) of the 
present method, that of "total bytes". In other words, prior art methods run only one of the 
three "stages" disclosed herein, thus being much less efficient in eliminating packet 
fragmentation. Dividing the operation into such "stages" allows the OLT to have flexibility in 

30 calculating the grant length, as described above. The major inventive feature of the method 
appears in step 514, in which packets are "marked" as "granted", even though they are still in 
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the sub-queue, while additional calculations are then performed as if these "marked as granted" 
packets were transmitted. Step 522 is the one responsible for the decision to continue to the 
next cycle. 

FIG. 6 shows an example of a queue egress process according to the present 
5 invention, in the case in which ihe OLT grant length precisely matches the sum of packets 
length below threshold for all sub-queues. In (a), packets P1-P14 display an initial queue 
occupancy: PI indicates a first packet transmitted, P2 indicates a second packet transmitted, 
and so on. For simplicity, only 3 sub-queues marked "0", "1" and "2" are displayed, and all 
thresholds of the sub-queues are identical, and marked as Threshold 640. The OLT transmits a 
10 grant that has a length equal to the sum of the reported bytes below threshold, i.e. 

m 

(P1+F2)+P3+(P4+P5+P6). The grant is sufficient to include all the packets below the 
threshold. These packets are stored in a separated storage 650, shown at the bottom in (c). 
They are the next packets to be transmitted, and will not be included in future reports. Packets 
P7 - P14 in FIG. 6(b) are the only packets considered in the current queue status, and the only 

15 packets that will be reported. The queue status is updated as if packets PI to P6 were 
transmitted. It is clear that it is not necessary to physically copy the packet(s) to separate 
storage 650. as one could use pointer management manipulations for that purpose. 

FIG. 7 shows an example of the timing relation between a queue egress process and 
an ingress process, as occuring using the method described herein. The top (a) section shows a 

20 queue ingress timeline T with items (packets) marked 11-113 from left to right. The bottom (b) 
section shows packets arranged by priority in three sub-queues "0", "1" and "2". Inside each 
item, there are two numbers: a bottom one starting with 1 and marking the ingress order, and a 
top one marking the egress order. Box 19 marks the event of packet reception. Tliere are two 
major events on the ingress timeline: the first, item 700 (which coincides with the packet 

25 reception in box 19) is the preparation of a report message, which is done just before the next 
transmission requiring report. The second event, item 702, is the reception of a grant by an 
ONU. Packets II - 18 were received before the report was prepared in item 700, and packets 19 
- 112 were received before the grant was handled in item 702. Item 710 marks the packets 
existing in sub-queue #0 when the report was prepared, while items 711 and 712 mark the 

30 same for sub-queues #1 and #2 respectively. Item 720 marks the packets existing in sub-queue 
#0 when the grant was received. 



9 
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As can be seen, a higher priority packet will be selected for transmission before a 
lower priority packet even if the lower priority packet arrived earlier. For example, the third 
packet received, i.e. item 13, will be transmitted after the fourth packet received, i.e. item 14. In 
another example, II, the first packet received, will be transmitted after 16, the sixth packet 
received. Item 19, which identifies the ninth packet received, is still below threshold (i.e. it has 
priority over packets above threshold) but .since it was received after the report was prepared, it 
will be transmitted after the twelfth packet received (item 112), because the infomwtion by the 
algorithm is the status of packets below threshold at the report preparation moment. Item 113, 
which identifies the thirteenth packet received will not be transmitted at all in the next grant, as 
it was received after the grant was handled. 

Threshold setting 

In the dynamic bandwidth allocation methods and algorithms of the present invention, 
the values of the thresholds greatly affect the order in which packets will be granted, the 
balance between different priorities, and the possible granularity for. grant length selection. The 
last item is a result of an OLT decision, which, in order to avoid fragmentation error, may take 
for grant length calculation either the value of "bytes below threshold" or of "total bytes". As 
the span between these two values is potentially large, setting the threshold correctly is 
important when targeting an allowed bandwidth for a user. The present invention discloses 
three different embodiments of threshold setting methods. 

In a first embodiment of a threshold setting method according to the present invention 
there is provided a mechanism that adjusts dynamically the thresholds, using an improvement 
on a prior art mechanism. This mechanism is called Weighted Fair Queuing (WFQ) and is 
adapted herein to a distributed switching architecture, as the ONU is remotely controlled by the 
OLT. The "adaptation" includes enhancing the WFQ algorithm by introducing a threshold 
concept inside it. The WFQ method and its derivatives are based on ordering the traffic in 
classes ("classification"). The classification process is well known in the art. Each class 
receives a constant share of the bandwidth. For example, class I has 40%, class 2 has 30%, 
class 3 has 10%, and class 4 has 20% of the bandwidth. This guarantees deterministic and fair 
bandwidth control. In order to support WFQ. an ONU must support classification. Flows based 

10 
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on packet parameters are directed to specific classes. 

FIG. 8 shows an implemenialion of WFQ using threshold setting according to the 
present invention. The implemenialion is described as a flow diagram, and effected using a 
Slate machine. For support of multiple ONUs, the OLT should create multiple instances of this 
state machine, one per each ONU. HG. 8a shows the operating environment. In step 800. the 
OLT receives a report message from an ONU. In slep 802, ihe OLT sets a grant length to the 
value of the sum of "bytes below threshold" as reported by all queues. In step 804, the OLT 
transmits the grant message toward the ONU. 

FIG. 8b shows the innovative adaptation of WFQ with thresholds according to the 
present invention (i.e. the v^ay the OLT determines the threshold for transmission). In step 850, 
the OLT receives a WFQ configuration, in the form of the ratios of each sub-queue priority. 
Packets from a certain class are stored inside a specific sub-queue, i.e. a class ratio is the sub- 
queue ratio. The desired grant length is received as well from a management system, 
responsible for subscriber agreements (not shown). In step 852, variables for each sub-queue, 
storing the number of bytes metered (counted) during ONU transmissions, are initialized to 0. 
In step 854. the OLT calculates the threshold for each sub-queue, using preferably the 
following scheme: the desired grant length is multiplied by the sub-queue (class) ratio and 
further multiplied by a calibration factor, typically equal to 1.25, and the product is sent as a 
threshold to the sub-queue. For example, if the desired grant length is 8000 bytes, if the class 
ratios are 03, 0.4, 0.2, 0.1, and if the calibration factor is L25, the thresholds are respectively 
3000 (8000 X 03 x 1.25), 4000, 2000, and 1000. Evidently, the constant shown here are 
exemplary only, and other constants can be selected. The OLT then transmits a message 
containing the thresholds of all sub-queues to the ONU in step 856. 

The following steps are optional, and are required only if an adaptive mechanism is 
desired. In step 858, the OLT counts the number of bytes transmitted from each sub-queue. In 
step 860, the OLT adds the counted value to the value stored in a total counted variable. In step 
862, the OLT checks if the ratios between the counted values of the sub-queues and expected 
values (calculated by summing all the counted bytes of all sub-queues, and then multiplying 
the sum with the configured ratio per sub-class) differ significantly, for example by a 10% 
relative difference or a 5% absolute difference. These differences may result from a variance in 
packet length between sub-queues. If no difference is found, the OLT returns to monitor the 
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number of bytes iransmilted in step 858. If a difference is found, the OLT adjusts the 
thresholds in step 864. The adjustment can be done in many ways, for example by increasing 
the threshold for the deprived sub-queues (meaning those queues whose percentage of 
transmitted bytes relative to the sum of transmitted bytes of all sub-queues is less than 

5 configured), and by decreasing the threshold for the advantaged sub-queues (meaning those 
queues whose percentage of transmitted bytes relative to total transmitted bytes is more than 
configured). After adjustment, the OLT returns to step 856 to transmit the message. 

The key step is 854, in which the threshold per sub-queue is calculated based on WFQ 
ratios. In contrast with standard WFQ algorithms, which base the packet selection on 

10 mechanisms that measure transmitted rate, in the improved WFQ method of the present 
invention includes two innovative features: a packet selection based on setting a threshold, 
which defines a rule for status repjort, and the use of the ONU property to transmit first the all 
packets below threshold, which allows easy maintenance of the ratio between priorities, 
without optional periodic adjustments. 

15 In a second embodiment of a threshold setting method according to the present 

invention, there is provided a mechanism that adjusts dynamically the thresholds to predict the 
reported bytes below threshold. This mechanism is named Target Bandwidth Adaptation 
(TABA). The goal is to match a grant length as closely as ppssible to a desired length. The 
mechanism sets all threshold values of all sub-queues to be identical. That is, all priorities have 

20 the same threshold. The main concept is to increase the threshold values when the sum of 
reported bytes below threshold of all priorities is too low, and to decrease the threshold values 
when the sum of reported bytes below threshold of high priority queues is too high. The 

* 

concept is illustrated in FIG. 9 

FIG. 9 shows a flow chart of the steps of a threshold setting method using the TABA 

25 mechanism. The flow chart shows the handling of one ONU by an OLT related state machine. 
As with the WFQ embodiment of FIG. 8, for support of multiple ONUs, the OLT should create 
multiple instances of this state machine, one per each ONU. In step 900, the OLT sets an initial 
value of a threshold (which is identical for all sub-queues), typically to (L5 / number of 
priorities) * desired grant length. The number of priorities is the number of sub-queues in a 

30 queue and the number of packet classes. In step 902, the OLT transmits the threshold value 
toward the specific ONU. In step 904, the OLT receives a report from the specific ONU. In 
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Step 906, the OLT compares ihe sum of the values of "lotal bytes" reported in step 904 to the 
desired grant length. If the sum is smaller than the desired grant length, the operation returns to 
step 904, as no adjustment can be done lo the threshold, since the ONU does not have enough 
data to adjust according lo. In other words, the ONU traffic is too low, and not enough to fill 
the desired grant length, regardless of any effort made to adjust the threshold. If the sum is 
equal or larger than the desired length, operation continues from step 908. In this step, the OLT 
compares the sum the values of reported bytes below threshold with the desired grant length. If 
the sum is larger than the desired length, the operation continues from step 914. If the sum is 
smaller than the desired length, the operation continues from step 910. In^step 910, the 
thresholds (all equal to one value) are increased by an arbitrary function, for example by 
multiplication with a constant or by addition of a constant. The execuUon then goes to step 
912. in which a new message that updates the threshold value is transmitted, and the execution 
returns to step 904. In step 914, th.e OLT sums the values of reported bytes below threshold 
from the highest priority to a configurable priority to obtain a "high-priority" sum. Typically, 
the configurable priority will be 50% of the highest priority, rounded up. The high priority sum 
is then compared with the desired grant length in step 916. If the high priority sum is smaller 
than the desired length, the execution returns to step 904. Otherwise, execution continues from 
step 918, where the thresholds are decreased by an arbitrary function, for example by division 
with a constant or by subtraction of a constant, following which the execution goes to step 912. 

The key steps are 908 and 916 that compare the desired grant length with information 
arriving in a report message. The comparisons allow the adaptation of the threshold to predict 
the grant to be as close as po.ssible to a desired value. 

For example, assume that the desired grant length is 10000, and the number of 
priorities is 4. The initial threshold value is (1.5 / 4)* 10000 = 3750. For simplicity, assume that 
the reported number of "total bytes" and bytes below threshold of all priorities is identical. 
Assume that in the first cycle, the reported value of "total bytes" is 2000 per priority. As this 
value is smaller than the threshold, it will be reported as the amount of "bytes below 
threshold". Since the sum of the "total bytes" is 8000. i.e. smaller than the desired grant length 
of 10000 (as checked in step 906), no adjustment is done. Assume that in the second cycle, the 
reported value for "total bytes" is 5000. The bytes below threshold reported value is 2000 
(since it must be smaller than the threshold which is 3750), As the sum of bytes below 



13 



wo 2004/025903 



PCT/IL2003/000702 



threshold is smaller ihan the desired grant length (10000), the threshold should be increased. In 
this example, the threshold is increased by 20% to 4500, and a threshold update command is 
transmitted to this ONU. Assume that in the third cycle, the reported value of "total bytes" is 
again 5000, and the reported value of bytes below threshold is 3000. The sum of bytes below 
threshold is now 12000, hence the threshold should not be increased. The sum of "bytes below 
threshold" of the highest priorities (which was assumed here to be the group of the two highest 
priorities), i.e. the "high-priority" sum deHned above is 6000, hence the threshold should also 
not be decreased. In other words, after the third cycle, the threshold is left unchansed and the 
cycles end. 

In a third embodiment of a threshold setting method according to the present 
invention there is provided yel another mechanism that adjusts dynamically the thresholds to 
predict as close as possible the traffic partition between priorities. This mechanism is named 
Priority Traffic Monitor (PTM). As opposed to the previous (TABA) method, each priority has 
in this case a unique threshold value, based on the amount of data arriving from the priority. 
The main concept is to set the sum of all thresholds to a fixed value, typically larger than the 
length of a desired grant. The threshold values are adjusted based on actual "bytes below 
threshold" reported per sub-queue associated with a priority. 

FIG. 10 shows a flow chart of the steps of a threshold setting method using the PTM 
mechanism. The flow chart shows handling of one ONU by an OLT related state machine. As 
in the two previous (WFQ and TABA) methods, the PTM method may be used with a plurality 
of ONUS, by providing multiple instances of the state machine. Steps 1000-1004 are 
essentially similar to steps 900-904 in HG. 9. In step 1000, the OLT sets the initial value of 
each threshold, typically to (1.5 / number of priorities * desired grant length). In step 1002, the 
OLT transmits the threshold value toward the specific ONU. In step 1004, the OLT waits until 
a report message is received from the specific ONU. In step 1006, a loop defined by a loop 
index is run over all priorities. When the loop ends, the execution returns to step 1002. As long 
as the loop runs, step 1008 is comparing the reported value of bytes below threshold for the 
current sub-queue associated with a priority loop variable with the expected threshold for the 
same sub-queue. That is. the loop index marks the presently examined sub-queue. If the value 
of reported bytes below threshold is too big, meaning the reported value is larger than a 
predefined portion of the threshold, for example 2/3, the execution goes to step 1010 in which 
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ihe threshold of ihe sub-queue associated with the loop variable priority is increased by a 
constant value, while the other thresholds of the other sub-queues are decreased by the same 
constant divided by (number of priorities -1). For example, if the reported value of bytes 
below threshold is 5000 and the expected threshold is 6000, then the threshold for this priority 
will be incremented, based on the 2/3 ratio for this example. Assuming there are 4 priorities, 
and the value added is 600, then following this step the threshold for this priority will be 6600, 
while all the other thresholds of all other priorities will be subtracted by 200. Afterwards, the 
execution returns to the loop to step 1006. If the value is too small, meaning the reported value 
is smaller than a predefined portion of the threshold, for example 1/3, the execution goes to 
step 1012 in which the threshold of the sub-queue associated with the loop variable priority is 
decreased by a constant value, while the other thresholds of the other sub-queues are increased 
by the same constant divided by (number of priorities -1). Afterwards, the execution returns to 
the loop to step 1006. Jf the value is neither too big nor too small, meaning it is located 
between the high and low thresholds, no adjustment is required, and the execution returns to 
the loop in step 1006. Steps 1010 and 1012 are aimed at maintaining the sum of all thresholds 
constant. 

The key step is 1008, which enables investigation of each sub-queue in terms of of 
reported values vs. threshold values, to determine how to adjust the threshold, which is either 
increased, decreased, or left unchanged. 

For example, assume that the desired grant length is 10000, the number olF priorities is 
4, and the update constant is 450. The initial threshold value is (1.5 / 4)*100(X) = 3750. 
Assume that in the first cycle the reported "bytes below threshold" is 3000 for all priorities. 
The loop begins running on each priority. For each given priority, the value of the threshold 
should be increased, while other priority thresholds should be decreased. For example, the 
value of the first priority threshold is increased by 450. and that of all other priority thresholds 
are decreased by 450/3. After the first loop execution the thresholds will accordingly be 4200, 
3600, 3600 and 3600. After the second execution the thresholds will be 4050, 4050. 3450, 
3450. After the third execution the values will be 3900, 3900. 3900, 3300, and at the end the 
values will be 3750 for all priorities. As seen, the original values of all thresholds are still 
valid, since all the reported "bytes below threshold" were equal. Assume that in the second 
cycle, the reported bytes below threshold were 3000, 2000, 2000 and 1000 respectively. After 
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the first loop execution, the threshold values will be (as in the first loop of the first cycle) 4200, 
3600, 3600 and 3600. The second and third execution will not modify the values, since the 
value of "bytes below threshold" is bigger than the condition to decrease (1/3 of threshold), and 
smaller than the condition to increase (2/3 of threshold). In the last execution, the value of 

5 "bytes below threshold" is smaller than 1/3 of the threshold, requiring a decrease in the 
threshold value for this priority, and an increase in the threshold value of other priorities. After 
the last execution, the threshold values will be 4350, 3750, 3750, 3150. 

For the sake of completeness, FIG. 1 1 presents two examples for determining the 
desired grant length. The right side mechanism (steps 1100-1102) is based on adjusting the 

10 desired grant length to minimum bandwidth, and the left side mechanism (steps 1150-1156) is 
based on adjusting the sum of all ONU desired grant lengths to cycle length. That is, we take 
all desired grant lengths of all ONUs, sum them, and adjust them to cycle length. A "cycle 
length" is the number of bytes granted at a single OLT granting decision, covering all ONUs. 

Beginning with the right side mechanism, in step 1100, a new or updated minimum 

15 bandwidth (MIN BW) requirement arrives from a management system responsible for 
customers Service Agreement Level for one of the ONUs. In step 1102, the MIN BW value is 
used to calculate the desired grant length, which should be equal to (MIN BW / available BW) 
* cycle length. 

The left side mechanism begins in step 1150, in which the OLT receives, a new or 
20 updated "fairness parameter" requirement for one or more ONUs. There are many possible 
representations of a fairness parameter.. For example, bandwidth may be divided linearly 
between ONUs based on the fairness parameter. In step 1152, the sum of all fairness 
parameters (one per ONU) is calculated. In step 1154, a loop is executed, running over all 
ONUs. In step 1156, the desired grant length is calculated for the loop index (step 1156 is 
25 executed for each loop cycle) by, preferably using the formula: grant length = (ONU fairness 
parameter / sum of fairness parameters) * cycle length 

All publications and patents mentioned in this specification are herein incorporated in 
their entirety by reference into the specification, to the same extent as if each individual 
publication or patent was specifically and individually indicated to be incorporated herein by 
30 reference. In addition, citation or identification of any reference in this application shall not be 
construed as an admission that such reference is available as prior art to the present invention. 
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While ihe invention has been described with respect to a limited number of 
embodiments, it will be apprecialed that many variations, modifications and other applications 
of the invention may be made. What has been described above is merely illustrative of the 
application of the principles of the present invention. Those skilled in the art can implement 
other arrangements and methods without departing from the spirit and scope of the present 
invention. 
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WHAT IS CLAIMED IS 

1. In a passive optical network (PON) a method for irnnsmilting packets by an optical 
network unit (ONU) comprising the steps of: 

a receiving a grant having a grant length from an optical line tenntnal (OLT) of 
the PON; and 

b. based on said grant, calculating an ONU packet egress order that eliminates 
packet fragmentation. 

2. The method of claim 1, wherein said step of calculating is preceded by a step of 
handling out of band infonnation, and includes handling a sub-queue of a given priority. 

3. The method of claim 2, vvherein said handling includes checking said sub-queue for 
ungranted packets, and wherein said step of calculating includes performing a three stage test 
on each of said ungranted packets, each of said stage tests involving a stage variable. 

4. The method of claim 3, wherein said stage variable is selected from the group 
consisting of reported bytes below threshold, reported total bytes, and total bytes, and wherein 
said performing of a stage test involving a stage variable includes comparing a value of said 
stage variable to zero. 

5. The method of claim 4, wherein said ungranted packet is marked as granted, if the 
result of said comparison is that said value of said stage variable is greater than zero. 

6. The method of claim 1, wherein said grant is a flexible grant set by said OLT based on 
information received from the ONU. 

7. The method of claim 7, wherein said information includes a combination of values of 
bytes below threshold and total bytes. 

8. The method of claim 7, wherein said threshold is adaptive. 
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9. The melhod of claim 7, wherein said values of bytes below ihreshold and total bytes are 
accumulated from highest to lowest priority. 

10. In a passive optical network (PON), a method for eliminating packet fragmentation 
comprising the steps of: 

a. providing an optical line terminal (OLT) connected to a plurality of optical 
network units (ONUs), each of said ONUs transmitting packets arranged in sub-queues having 
a total byte length, said packets transmitted in response to a grant received from said OLT, said 
grant having a srant length; and 

b. matching said total byte length with said grant length, whereby the 
fragmentation loss is eliminated. 

* 

11. The method of claim 10, wherein said step of matching includes hiding, by each said 
ONU, an update in a queue status from said OLT. 

12. The method of claim 1 J, wherein said hiding includes freezing a transmission order of 
queues. 

13. The melhod of claim 1 1, wherein said step of matching further includes checking, from 
highest to lowest priority each of said sub-queues, identifying in each said sub-queue 
ungranted packets with respective ungranted packet lengths, and marking each said ungranted 
packet as about to be transmitted. 

14. The method of claim 13, wherein said marking includes comparing to zero a stage 
variable selected from the group of reported bytes below threshold, reported total bytes, and 
total bytes, and marking said ungranted packet as granted if said stage variable is greater than 
zero. 

15. The method of claim 14, wherein said marking is followed by removing said ungranted 
and marked packet length from reported and current variables. 
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16. A melhod for selling a ihreshold for dynamic bandwidth allocation in a passive optical 
network that includes an optical line terminal (OLT) and a plurality of optical network units 
(ONUs), the method comprising the steps of: 

a. providing a weighted fair queueing configuration to the OLT; and 

b. providing a ihreshold used in combination with said weighted fair queueing 
configuration by ihe OLT while granting a grant with a desired grant length lo an ONU. 

17- The meihod of claim 16, wherein said step of providing a threshold includes 
calculating, by the OLT, a threshold for each sub-queue, and transmitting said ihreshold to said 
ONU. 

18. The method of claim 17, wherein said calculating said threshold includes multiplying 
said desired grant length by a class ratio of said sub-queue and by a calibration factor. 

19. The melhod of claim 18, wherein said threshold is an adaptive ihreshold, and wherein 
said transmitting is followed by counting, by the OLT, of bytes transmitted from each said sub- 
queue, adding said counted bytes to a total bytes counted variable, checking a difference 
between measure and expected class ratios, and based on said checking, adjusting said 
threshold. 

20. A method for selling a threshold in a passive optical network that includes an optical 
line terminal (OLT) and a plurality of optical network units (ONUs). ihe OLT granting grants 
to the ONUs, the ONUs transmiuing packages arranged in sub-queues in response to the 
grants, the melhod comprising the steps of: 

a. performing a comparison between parameters reported by an ONU and a 
desired grant length; and 

b. adjusting a threshold based on the results of said comparison, thereby providing 
a target bandwidth adaptation mechanism in which the threshold value of all sub-queues is 
identical. 
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21. The meihocl of claim 20, wherein said parameters include a reported total bytes 
parameter, and wherein said step of performing a comparison includes summing said values of 
reported total bytes for all sub-queues lo obtain a total bytes sum, and, if said total bytes sum is 
larger than said desired grant length, summing values of reported bytes below threshold of each 
sub-queue to obtain a bytes below threshold sum. 

22. The method of claim 21, wherein said step of performing a comparison further includes 
comparing said bytes below threshold sum to said desired grant length, and wherein said step 
of adjusting said threshold includes decreasing said threshold if said bytes below threshold sum 
is larger than said desired grant length. 

23. The method of claim 21, wherein said summing of values of reported bytes below 
threshold of each sub-queue lo obtain a bytes below threshold sum includes summing said 
values from a highest priority to a configurable priority to obtain a high-priority sub-queues 
sum 

24. The method of claim 23, wherein said step of performing a comparison further includes 
comparing said bytes below threshold high-priority sub-queues sum to said desired grant 
length, and wherein said step of adjusting said threshold includes increasing said threshold if 
said bytes below threshold high-priority sub-queues sum is smaller than said desired grant 
length. 

« 

25. A method for setting a threshold in a passive optical network that includes an optical 
line terminal (OLT) and a plurality of optical network units (ONUs), the OLT granting 
periodically a grant having a grant length to each ONU, each ONU transmitting packages 
arranged in sub-queues in response to a grant, the method comprising the steps of: 

a. providing a plurality of priorities each associated with a sub-queue of packages, 
each said priority having a unique priority threshold; and 

b. adjusting each said priority threshold such that a sum of all said adjusted 
priority thresholds has a fixed value. 
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26. The meihod of claim 25, wherein said fixed value is larger lhan ihe grant length. 

27. The meihod of claim 25, wherein said step of adjusting includes comparing a value of 
bytes below threshold of each said sub-queue with said unique priority threshold. 

28. The method of claim 27, wherern said comparison finds that for a particular said sub- 
queue said value of bytes below threshold is smaller than said threshold, and wherein said step 
of adjusting further includes decreasing the threshold of said particular sub-queue and 

■ 

increasing the threshold of each other said sub-queue to obtain said fixed sum value. 

29. The meihod of claim 27, wherein said comparison finds that for a paaicular said sub- 
queue said value of bytes below threshold is greater than said threshold, and wherein said step 
of adjusting further includes increasing the threshold of said particular sub-queue and 
decreasing the threshold of each other said sub-queue to obtain said fixed sum value. 
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